Entropy and data analysis

Entropy based Malmquist Productivity Index in Data Envelopment Analysis

Malmquist Productivity Index (MPI) is one of the most famous indices, which is used for estimating the productivity change of a Decision Making Unit (DMU) during the time. Virtually any empirical study that uses MPI, reports average of the productivity indices they estimate to represent the overall tendency in productivity changes. In such a case, productivity indices of a DMU are considered wi...

Maximum Entropy Data Analysis

Entropy-based Consensus for Distributed Data Clustering

The increasingly larger scale of available data and the more restrictive concerns on their privacy are some of the challenging aspects of data mining today. In this paper, Entropy-based Consensus on Cluster Centers (EC3) is introduced for clustering in distributed systems with a consideration for confidentiality of data; i.e. it is the negotiations among local cluster centers that are used in t...

On data analysis and variable selection: the minimum entropy analysis

In this work, we present a minimum entropy analysis scheme for variable selection and preliminary data analysis. The variable selection can be achieved by the increasing preference of variables. We show such a preference to has a unqiue form, which is given by the entropy of models associated with variables. Evaluating the entropy provides a complete ranking scheme of variables. This scheme not...

Block-Entropy Analysis of Climate Data

We explore the use of block entropy as a dynamics classifier for meteorological timeseries data. The block entropy estimates define the entropy growth curve H(L) with respect to word length L. For a finitary process, the entropy growth curve tends to an asymtotic linear regime H(L) = E + hμL, with entropy rate hμ and excess entropy E. These quantities apportion the system’s information content ...